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I. INTRODUCTION 


The goal of this thesis, which is a continuation of a research being conducted at 
Naval Postgraduate School, 1s to describe a technique for obtaining particle size 
information from holograms taken of the combustion products in a rocket combustion 
Siemiecre  Mesuliimate output of the process 1s gomeg to be used to study the effects of 
addition of alumimum and other metallic particles on the performance in solid 
propellant motors. Tle main benefit of adding the aluminum ts to suppress Iugh 
frequency combustion mstabilitres and to merease the delivered performance. The 
other metallic additives are generally added only to mcrease the acoustic stabilization 
in reduced-smoke propellants. These are a small amount of aluminum oxide, 
mimeoniuin, etc. The particle size distribution has a major effect on the performance 
mimouvinout the rocket motor and nozzie [Ref. 1]. Direct observation is the most 
effective method to get the information about particles and to evaluate the existing 
analvtical methods, because no data exists which will pernut the prediction of the 
distribution of the particle sizes in the combustion chamber of the motor. 

Migi@etdloiic tecnim@ues, which have been used to record the dynamics in the 
combustion chamber, are still to be improved. This 1s accompanied by improvements 
in the taking and processing of holograms. Previous work done in processing the 
images have included the use of an [BM PC/AT with special software and hardware 
[Ref. 2] and an attempt to reduce speckle noise by applying some nonlinear filters (the 
Signia filter, the Geometric filter and the Local Statistical filter), which were taken 
from the synthetic aperture community [Ref. 3]. 

In Reference 2, Redman focussed on tmage capture, image digitization and 
particle sizing of the holograms. ImageAction software from Imaging Technology, 
Inc., was used under operator control to process the image, and to suppress the speckle 
effect. Locally developed Fortran programs were then used to process the images and 
to size the particles. Due to computation time and computer memory size constraints, 
Redman’s efforts worked with only one quarter of the screen image (256 x 256 pixels). 
A major problem was that the processing time for the one quadrant of the screen was 


taking approximately 4 hours. 


In an attempt to reduce the speckle effect, Redman also investigated image 
averaging techniques. One method used a spinning mivlar disk to blur the speckle 
background during the integration time of the imaging tube. Another used a digital 
averaging of several captured images. It was found that the spinning mvlar disk was 
optimal to reduce the speckle in that the same amount of speckle reduction could be 
done in a simpler fashion than the digital averaging. The digital averaging technique 
was abandoned in later work. The speckle was further reduced by using some built-in 
routines of the ImageAction software. First. a blur filter was applied followed by a 
lowpass filter. The two-step process was then repeated until the filtered image satisfied 
the user's needs. When the correct filtering was done, the speckle was significantly 
reduced. It was noted, however, that resolution was also reduced and that close 
particles would tend to merge into one unresolved clump after processing. No attempt 
was made to quanuze the loss of resolution in this early work. The next processing 
step was the application of a threshold to remove all information from the background. 
The thresholded image was then processed by the Fortran routines for object 
identification, counting and sizing. Twenty microns was the best resolution that could 
be achieved using these speckle reduction techniques and computer processing. 

This thesis improves the previous work both in reducing the speckle moisemiag 
trving some locally developed filters (the 5x5 Convolution filter and the 3x3 Gaussian 
filter) and in developing a Fortran program that reduces the time for extracting the 
feature size. Feature data extraction programs can be run almost 100 times faster now. 
[t takes about LO minutes to process the entire visible monitor screen image instead of 
4 hours for one quarter of the screen required in the previous study. Furthermore, it 
was observed that although the locally developed filters do not provide any significant 
improvement in terms of reduction of the speckle compared to the previously 
developed nonlinear filters of Ref. 3, they can be run much faster. Additionally the 
work for this thesis suggests that the histogram of the particle size distribution reaches 
a representative shape after summing information from a sufficient amount of particles 
(approximately 1,000 particles). Further study is needed to verify this initial 
observation. 

This thesis conststs of six chapters. The first section of Chapter Two provides 
some background material to explain the process for acquiring the hologram images 
and the software used for processing the image. The second section explains the steps 


of the data extraction process and the details of the algorithm. Chapter [hreejataiie 
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beginning, gives a description of speckle and speckle index, a parameter used to 
determine how much speckle is present. Other sections provide the definitions of the 
two locally developed filters (the 5x5 Convolution filter and the 3x3 Gaussian filter) 
and compares these filters with previous nonlinear filters (the Local Statistical filter, the 
See metic iilter tne Sigina filters Ghapter Four gives a brief descriptron of the steps 
for the feature identification and sizing process and evaluates the performance of the 
Process, FUrthicrmore, Current measurement results are given in this chapter. The 


concluding remarks are included in Chapter Five. 


tl 


Il. HOLOGRAM IMAGE PROCESSING 


As mentioned in the previous chapter, holographic techniques are used to 
capture the image of the combustion products in a rocket combustion chamber during 
firing. The pulsed ruby laser utilized in the recording process uses a glass diffuser in its 
lumination path. This diffuser is necessary to cut down the presence of schlieren 
interference fringes produced by the thermal and density gradients surrounding the 
burning particles in the rocket motor [Refs. 4,5]. 

The hologram is then reconstructed using a krvpton laser and viewed through the 
microscope using 2x, 4x or 1Ox magnification. The diffuse hght from the recording 
interferes with the reference wave of the krypton reconstruction laser. This random 
interference causes speckle to be introduced into the image. By attaching a 0.5 lux 
low-hght-level camera and a video cassette recorder to the microscope, the speckle- 
corrupted image is recorded and preserved for later use. Explanation Oiiime 
reconstruction process 1s described in more detail in the next section. 

After the reconstruction of the hologram, the entire 1mage processing and feature 
extraction process is done with an IBM-PC,;AT microcomputer. Basically, the 
hardware and software requirements for the system can be summarized as following, 

I. PC Vision frame-grabber board (installed on the IBM-PC/AT), 

2. {fmageAction and Itex. PC software (both by Imaging Technology), 
3, An analog video monitor, 

4. A video cassette recorder, and 

5. Graphics software (STATGRAPHIGS). 

Recently, the computer system has been upgraded with a [6 NITIZee 
microprocessor board. This board has provided significant improvement in processing 
Speed: 

Three test objects have been used in the phases of study. Two of these objects 
were imaged under white light as the highest contrast for the calibration purposes. 
They were also recorded as holograms in the test setup to duplicate the test geometry. 

The first object was a calibration reticle produced by LEOS, Ine. 11 isiaisaess 
pattern and consists of twenty three standard sizes ranging from five to ninety-three 


microns in diameter. Circle sizes and relative positions of the test array and pattern 


are as shown in Figure 2.1. Approximately 10,000 photodeposited spots form the 
circular portion of the reticle. The diameter of the circular part is almost eight 
nullrmeters. The object contains an extra test pattern at its night side showing the 
samiple sizes of the particles. The circular part can be used to obtain the particte 
distribution and statistics to cahbrate the speckle reduction methods. Also, the test 
pattern can be used to coarsely measure the resolution sensitivity and speckle reduction 
capability of the method. 

The second object of study was the 1951 USAF Standard Resolution Chart. This 
was used for resolution degradation comparison of the filters, because it provides more 
continuous and sensitive measuremcnt of resolution degradation than the LEOS 
calibration array (Figure 2.2). 

The final objects were the reconstruction images obtained from rocket motor 
holograms recorded during firing using fuel samples supphted by the Air Force. Thev 
were used for the ultimate goal of the investigation, to obtain the feature distribution 
and statistics of the particles in actual combustion conditions. Comparison and 
relations between the tmages obtained from the calibration array and the rocket motor 


holograms are prescnted in Chapter Five. 


A. ACQUIRING THE HOLOGRANI IMAGE 

The holographic techniques that are used to capture the image of the combustion 
products in a rocket combustion chamber during firing and the reconstruction process 
of this image have been describcd in detail in Reference | and 2. 

The hologram reconstruction scheme is shown in Figure 2.3. Basically, the 
hologram is reconstructed using a Krvpton laser (whose wavelength is close to that of 
the pulsed ruby laser used to record the hologram) and viewed through the microscope. 
The spinning mylar disk 1s another key part of the system, because the focussing image 
On the spinning mylar disk was found to reduce the speckle [Ref. 3: p. 39]. The low 
transmissivity of the mytar disk causes a reduction of the light at the input of the 
camera. Therefore, a 0.5 lux low-light-level camcra was attached to the system. Then, 
by attaching a VCR to the camera, the specklc-corrupted image can be recorded and 
preserved for later use. During the reconstruction phase, the random interference 
betwecn the diffuse light from the recording and reference wave of the krypton 
reconstruction laser produces the speckle which has proven to be one of the main 


problems of the feature extraction. 
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Pigiiies:- aes. yt Standard Resolution Chart. 


In the reconstruction process, the field of view (and the number of particles 
within that field of view) 1s determined by the magnification required to resolve the 
smallest particle. For each magnification power of the microscope, each pixel has a 
Senet fixed size. The particle size is measured in terms of pixels. This leads to a 
quantization error for those particles that are not exactly an integer number of pixels. 
ffeisemot yet understood how the TV camera tube quantized the image edge (1.¢., 
whether it rounds up, rounds down, or uses some other truncation scheme). In any 
event the edge is resolved to =] pixel. For a simall object this uncertainty 1s a large 
fraction of the image size. Fora large object. the uncertainty of size is negligible. 

The physical size of a pixel is determuned by including a cahbration object of 
known dimensions within the hologram volume. The combustion holograms included 
a screw profile. The known pitch of the screw 1s used to find the pixel dimensions. 

The 4x maguification proved to provide a reasonable processing time for one 
amore 11) one field of image With a smallest feature size of 3.7 microns. This cun be 
described as the quantization step size of partucle resolution measurement. For 
amelie, the sinallest particle in the LI-OS cahbration array is 5 microns. An 


uncertainty of *3.7 microns would lead to significant error if these particles were 
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resolved. The same error for a 17 microns (or greater) particle is tolerable for our 
initial measurements. A 10x magnification would improve the quantization error 
effects, but there would be fewer particles in the field of view thus requiring more 
computation time for the hologram volume. This 1s a fundamental tradeoff between 
acceptable quantization error and computation time. The magnification of 4x proved 


to be an acceptable compromise value. 


B. SOFTWARE FOR IMAGE ACQUISITION AND ENHANCEMENT 

As was discussed in previous studies [Refs. 2.3], the ImageActron and Itex PC 
commiercial software were the key elements of the entire process. [hrs software pernuts 
the user to process either the entire monitor screen or just some portion of tt. The user 
can describe anv rectangular portion of the monitor screen as an Area of Interest 
(AQT). It 1s possible to process an entire tmage which is made up of 512 x 480 pixels 
on the monitor screen, since last 32 rows of the monitor cannot be seen. lore detailed 
technical information about this software are available in the documentation 
(Refs. 6,7]. Now, some aspects of this software can be discussed in a general overview. 

1. Saving and Restoring the Image 

Both ImageAction and Itex,PC have the capability of saving the processed 
images and using the same images by restoring later. Menu-driven [mageAction 
subroutines or locally prepared user programs that call the Itex, PC subroutines provide 
this flexibility. Some subroutines were developed for saving and restoring the images in 
References 2 and 3, and they were also used during this phase of the investigation. 
Normally each stored image in a file has 64 bytes of header and 32 bytes of comment 
following this header. Then 256,144 bytes are used to store the entire image screen. 
Loading the images from the hard disk of the computer will save time over transferring 
the image from a floppy disk. It takes almost 10 seconds to transfer the image from a 
hard disk to the video screen, while twice that time 1s needed to transfer the image 
from the floppy disk drives. 

Another important detatl is that an image file saved by the Itex’PC or 
ImageAction softwares is an ASCII string file and may not be compatible with any 
other software’s data format. Some compilers such as Fortran can have problems 
handling this kind of string file. A sample conversion program that read the data and 
rewrote it in compatible form was written in Basic by Redman [Ref. 2: p. 66] for the 


use of a Fortran compiler. 


17 


2. Filtering 
Filtering is the most important step of speckle reduction techniques. Most 
speckle reduction techniques use simple convolution techniques. Detailed information 
about some of the speckle reduction filters are in the previous studies [Refs. 3.5,8.9,10]. 
The ImageAction and [tex’ PC software have many methods of image filtering 
and enhancement (3x3 Gaussian filter, 5x5 Convolution filter, 7x7 Convolutoneniiem 
Blurring, Sharpening, etc.). Every filter has the disadvantage of tending to blur or 
smear the actual particle shapes resulting in some loss of edge resolution. In part of 
the study for this thesis, the Gaussian filter and the 5x5 Convolution filter sais 
software Were evaluated for speckle reduction capability and resolution protection. 
This evaluation and the comparison of these filters with the other nonlinear filters like 
the Geometric filter, the Sigma filter and the Local Statistical filter [Ref. 3: pp aaaay 
ave discussed in the Next chapter 
3. Histogram 
An unage histogram is a plot of the number of pixels having a given value of 
gray level versus the value of the grav level. A good decision of the location of a 
thieshold can frequently be made after looking at the histogram of the image to 
differentiate the features from the background. Also, the histogram of an hologram 
nage gives a general idea about the population of the particles on the background. 
ImageAction and Itex’ PC have some subroutines to obtain the histogram of the image, 
and to display it on the screen. But, since there is no any capability of getting the 
hardcopy of the output, STATGRAPHECS software was used for this purpose during 
the study. 
4. Thresholding 
Thresholding is a process to set the pixels of the particles and the pixels of the 
background to two different values. As can be seen in the ideal case (Figure 2.4), there 
is no overlap area between the particles and the background. A threshold set between 
the regions will produce black particles on a white noise-free background. However, in 
an actual image, the particles and the background are going to overlap each other as in 
Figure 2.4. No matter where a threshold is placed, there are going to be errors while 
evaluating the image. 
Selection of the threshold value is going to play the main role on the amount 
of error created by the crossover area. During this study, the threshold value 1s 


determined by direct observation of the processed image, and the effectiveness of the 
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decision is going to depend on the experience of the user observing the particles. In 
each case, as a probabilistic conclusion, there will be some speckle described as a 
particles below the threshold. Naturally, it 1s obvious that some particles will be 
evaluated as a speckle and lost. 

A threshold subroutine was written by Edwards [Ref. 3: op. 43) 
subroutine uses the tex PC subroutines and has only one threshold limit. The pixel 
values below the threshold will be changed into zero value (black), and the others into 
level 255 (white). The PC Vision image memory board will preserve the original image 
until the thresholded image is mapped which ts an additronal user operation. This 
provides a chance to the user to try the varrous values of the threshold before deciding 
MiInMIeh 1s Gest: 

Proper filtering and other enhancement techniques are required to help 
separate the particles and background lobes before applying a threshold, and so to 


decrease the overlap area. 


C. PARTICLE DATA EXTRAGHION 

The main goal of this study was to improve a computer-aided system which 1s 
capable of measuring the quantity and the size of solid particles from holograms made 
of the combustion products in a combustion chamber of a rocket motor. Redman 
[Ref. 2] built the basics of this kind of measurement, but the previous study had some 
technica! constraints. 

The two most important desired improvements were to reduce the time to 
process the image, and to process the entire monitor screen tmage (512 xia 
Redman’s study was hmited to 256 x 256 images and required almost four hours 
processing time for this image. Srgnificant effort was spent to improve the speed and 
the efficiency of these programs. Now, 512 x 480 (visible full screen) tmages can be 
handled in approximately 10 minutes from frame digitization to the production of the 
feature data table. Improvements have been due to commercial availability of software 
that manipulates the fast-access video memory board (VMB), tmproved software 
revisions on locally produced programs, and the addition of a faster microprocessor. 

The revised program has been written in two sections in Fortran. The modular 
structure allows the user to easily test each segment. The first section of the program 
counts the number of features and codes each tndividual feature as a unique number in 
sequential order. The second section of the program sizes the features in terms of area 
and diameter. The expected sizes of the particles range from one micron to 200 


microns in diameter. They are also be expected to be nearly spherical in shape. 
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|. Feature Identification and Labeling 

The feature identification and labelling part of the algorithm requires the 
thresholded image. In the thresholded image, the features are coded into pixel value ‘0’ 
(black) and the background is coded into pixel value “255° (white). The thresholded 
image is then loaded into the feature identification and labelling prograni. 

The feature identification and labelling program consists of three phases. In 
the first phase, the program sweeps the image row by row moving from left to nght. It 
Beads caem pixelyov using Itex’PC subroutines. If the pixel value is “255', this pixel is 
skipped. When the program meets a ‘0’ value the first time, this particle pixel is 
labelled a unique feature number contained in a sequential counter. The counter value 
represents a temporary feature number and can range from ‘I’ to ‘254°. The prograin 
then continues to cheek the other pixels in the described order (row by row moving 
from left to mght). When the program meets another ‘0’ value, first the algorithm 
checks the previous pixel in the same row. If the previous pixel has a feature number, 
the current pixel is labelled with the same feature number, and the program continues 
foecheck the next pixel. If the previous pixel is a 255° background pixel. the program 
eiecksethe pixel above the current pixel. If that pixel (above the current pixel) has a 
feature number, the current pixel ts labelled with the same feature number of the pixel 
fw@everit, ihe prooram then continues to check the next pixel. But. if that pixel 
(above the current pixel) is a “255° background pixel, the prograin seeks a connection 
between the current pixel and the nght-upper diagonal pixels, one row above the 
current pixel. First, the algorithm checks the next pixel in the same row as the current 
pixel. If the next pixel is a ‘255’ value, the program assigns a unique sequential feature 
number to the current pixel. ({n that case the current pixel and the diagonal pixel can 
not belong to the same feature.) If not, the algorithm checks the pixel above the next 
pixel. (That pixel is the right-upper diagonal pixel of the current pixel.) The purpose 
of checking the next pixel value in the same row instead of checking the nght-upper 
diagonal pixel value directly is to be sure that the current pixel and the diagonal pixel 
belong to the same feature. When the algorithm meets a feature pixel on the riglit- 
upper diagonal direction, the current pixel is labelled with the diagonal pixel’s value. 
But, if the diagonal pixel is not a feature pixel, the other pixels to the right of the right 
diagonal are checked with the same logic. (The check continues until a row end is 
reached.) When the program meets a feature pixel, it assigns this diagonal feature 


value to the current pixel. Otherwise, the program labels the current pixel with a 
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unique sequential feature number. As a result of this algorithm, some feature 
geometries can produce features that have pixels that have different feature values. 

At the second phase of the program, all pixels of each feature are assigned the 
same feature Value and each feature will have a pixel assignment. Before starting the 
second phase, the program asks the user for the maximum Jength of the largest feature 
on the current monitor screen. The user gives an approximate answer for this question 
in terms of pixels. A typical value is seventy. This length ts going to describe a square 
Window to enclose the largest particle on the screen. The larger the value given, the 
longer the program takes to run as the loops truncate at the maximum) estimated 
particle size. 

Once “all the particles have been labelled as described in the first phaseyethie 
program performs the second phase in a fashion similar to the first phase. This time, it 
tests each pixel with the one above it. The sweeping direction is column by column 
moving from top to bottom. If there is a mismatch between the feature’s pixel values 
(except the background pixels), it assigns the previous pixel’s value to the one below it, 
and to the other adjacent pixels following it that have the same value. Each time, this 
process 1s done in the window described above. At the end of this phase, there will 
generally be some gaps between the values of the features, because of the pixels which 
have the values reassigned and the feature values cancelled. 

In the third phase, the features on the tmage are arranged in sequential order. 
First, the count register is reset. Then the program sweeps each row again, Wy femme 
finds two features having feature numbers not in sequential order, the algorithm 
substitutes the sequential value. 

When finished, each feature on the current screen is assigned a unique feature 
number from 1 to a maximum of 254. If there are more than 254 particles on the 
screen, they are also assigned the values like the others between | to 254, but they are 
differentiated with a special group count register. The group count register is increased 
by one for each new group. This restriction of 254 particles exists, because the gray 
levels of the pixels are represented with the values between 0 and 255 in the Itex PC 
software. 

2. Sizing the Features 

The second module of the locally produced programm ts to find the specific 
dimensions of the features. This part uses the images labelled in the previous module, 
and finds the horizontal and vertical diameters of the particles. It also finds the total 


area of the particles. All measurements are in units of nucrons. 


First, the program asks for the number of features on the screen. This was 
displayed on the screen as an output of the previous module that identified and labelled 
the features. This value should be saved as a comment if the user chooses to store thie 
labelled image. The program will save the value supplied by the user in a feature count 
register and count down as it finds the dimensions of each particle. Another question 
from the program is the magnification used with the microscope. This is necessarv for 
the calculation of the dimensions in microns. As can be scen. larger magnifications will 
affect the minimum particle resolution. For exainple, the resolution of the nunimum 
particle Which is covered just one pixel on the screen ts gorng to be 3.7 microns for the 
magnification of 4x. The real size of one pixel on the current screen is calculated bv a 
calibration object image, and duplicated for the inages which have Known 
magnifications. 

The last thing before running the program is for the user to enter the 
maxinium length of the biggest particle. [It is obvious that this will be the same as it 
was in the identification and labelling prograin. 

The program tests the pixels row by row from the left-upper corner to the 
right-lower corner. Whenever the algorithm meets a labelled feature, it builts the local 
window around it. Then, in this window, the program counts the pixels carrving the 
Sane number as the feature count register. The summation gives the area of the 
particle. [t goes through this window twice and calculates the vertical and horizontal 
diameters of the feature. As a final step, it changes the pixel values of the feature to 
the ‘O° (black particle) and decreases the feature count register by one. Then, the 
prograin continues sweeping the rows checking each pixel. Black ‘0’ and White °255’ 
pixels are skipped. Concurrently, stx separate registers test the measured dimensions of 
the features to find the maximum and muinunum particles on the current screen. At the 
end of the process, the program creates an output file to transfer and to process them 
in the STATGRAPHICS program. This table lists the feature identification number, 
the feature area, the feature’s x-width, and the feature’s v-width. 

3. Data Display 

Exinoniom ol «the fedattire data is the last step of the process. The 
STATGRAPHICS software was selected as a compatible graphics system. The reason 
for selecting the STATGRAPHICS software was its user friendly structure and its 
compatibility with the [IBM-PC/AT. Furthermore, it has good capabilities to exhibit 


the statistical data features. 


STATGRAPHICS imports the output data file of the previous program by 
using its Data Management Utilities. The details are summarized in Chapter Four. 
The SEATGRAPHICS program has a capability of exhibiting the results in a table or 
in a histogram. Each data display selection has other alternatives such as relative or 
cumulative distribution, etc. Furthermore, the program has the capability of adding 
the data files cumulatively allowing the user to see the statistics of more than one field 


of a hologram. At the end, the user can take a hardcopy of the emtire:scuns 


Ill. SPECKLE REDUCTION BY FILTERING 


In Reference 3, Edwards implemented three nonlinear speckle reduction filters 
(the Geometric filter, the Sigma filter and the Local Statistics filter), and compared the 
performances of these filters in terms of speckle index reduction, visual differences, 
timing constraints and histogram differences. These filters had alreadv been designed 
by the SAR (Synthetic Aperture Radar) community [Refs. 8,9,10]. The conclusion of 
the previous study was that the Geometric filter was found to be the best overall filter 
mcet. |): p. 30 mebut, themtimes needed for one iteration of these filters were still too 
much. For example, the fastest of them, the Sigma filter needs about 2.5 minutes per 
iteration for a full monitor screen. One iteration takes about 6 minutes for the 
Geometric filter, and 13 minutes for the Local Statistics filter. Since four to six 
iterations are tvpically required, significant amounts of time can be spent in reducing 
the speckle using these filters. Therefore, in this part of this investigation, some locally 
developed filters (5x5 Convolution filter and 3x3 Gaussian filter) were tested. Actually, 
they use simple convolution techniques. As can be seen at the later parts of the 
discussion, the locally developed filters are much faster than the nonlinear filters, but 
thev have worse resolution degradation performance. 

Before starting the introduction and the performance comparison of the filters, it 


Will be helpful to describe the speckle and speckle index. 


A. SPECKLE AND SPECKLE INDEX 

During the construction process, all holograms are recorded with diffuse 
ilumination from the laser. This is done in order to minimize the presence of schlieren 
interference fringes produced by temperature and density variations of the combustion 
gas products during the burn. A glass diffuser produces the diffuse illumination in the 
Ulununation beam. This diffuse illumination creates the speckle effect in the 
reconstructed images [Ref. 4: p. 2]. The presence of the speckle reduces the ability of a 
ima Olbserver to resolve the detail, [he effect of the speckle can be seen easily in 
Figure 3.1. The bottom part of the figure shows the speckle overlaying the features of 
the non-speckle image of the top part. Since the speckle can have a maximum size 
that is comparable to the smaller particles, smaller feature particles can easily be 
confused with the speckle. Therefore, the speckle creates the major problem in the 


feature extraction from holograms. 





(a) 





(b) 
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Speckle has been described as having the characteristics of a random 
multiplicative noise in the sense that the noise level increases with the average gray 
level of a local area [Ref. 10: p. 636]. In theory, it is known that the intensity of 
speckle has a shape of a negative exponential distribution. [Towever, in practical 
applications, it 1s quite difficult to describe a proper model. Basicallv, the SAR 
community proposed two major categories of the speckle-suppression tecliniques. The 
first category includes the averaging of multi-frames. This will help reduce the noise 
Variance. Kedman found that recording the image off a spinning mylar disk had the 
saine effectiveness as averaging the multi-frames, and was accepted as opumal in both 
speckle reduction and in processing time [Ref. 2: p. 42]. Techniques in the second 
category smooth the speckle after images have been reconstructed. To filter the 
speckle from the images requires a precisely defined statistical property, such as 
correlation between neighboring pixels and the standard deviation. Various filters 
belong to this post-image categorv. The important problem is the tendency of the 
Miers (G sljppress the desired sliapes as well as its speckle. This is known as the 
resolution degradation of the filter. 

The major indicator evaluating the speckle reduction capability of the filters is 
speckle index described by Crimmuns [Ref. 8: p. 651]. The algorithm proposed by 


Crimmuins was the following: 


The local deviation is defined as 


Cima) — “max {F(m+a,nt+b)} - min {F(m+a,n+b)} (3.1) 
and the local mean is 


H(m,n) = — yY F(m+a,n+b) (3.2) 
a,b=-l 


The speckle index is then defined by 


‘ (m.n) 
6(ni.n 
y —— (3:3) 
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speckle index = ——- _¥V 
- 1t(m1,n) 
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The speckle index gives the ratio of the standard deviation of the inage sector to 
the mean of the pixel values in a definite local region. A Fortran subroutine 
computing the speckle index was written by Edwards [Ref. 3: pp. 41-42]. The same 
subroutine was used to evaluate the performances of the filters developed for this 
thesis. 

In the equations above, M and N are the dimensions of the local area in which 
the speckle index was calculated, and F(m,n) represents the image in terms of the gray 
level of each pixel. Walues of M and N were selected as 240, since it was foulamen 


Edwards [Ref. 3: p. 19] to be a reasonable value. 


B. * THE SRECKEE REDUCTION PIETERS 

As mentioned in the previous section, in addition to the nonlinear filters some 
other filters based on basic convolution techniques were evaluated in terms of speckle 
suppression effectiveness. The most important difference between convolution 
techniques and nonlinear algorithins is that the nonlinear filters have been inplemented 
to suppress the speckle based on a multiplicative noise model, whereas the convolution 
algorithins are a type of region-dependent segmentation tools. 

Before starting the discussion of these special filters, there is a need to consider 
the fundamentals of the convolution algorithins. 

1. Region-Dependent Segmentation Techniques 

For the region-dependent algorithms, a region may be considered as an area 
which 1s finite and is surrounded bv a closed edge [Ref. 12]. Generally, the differences 
in grav level content are the major tools to establish the region characteristics in visual 
images. The other important feature which may be used for this purpose 1s texture. 
Texture can be described as a global repetition of a basic pattern in a local area. This 
is mostlv helpful to identify the edges. 

Basically, the convolution algorithms use a template (also called a mask or 
window). A template is a two-dimensional array which 1s designed to detect the 
invariant properties of a region. This method is used widely by the image processing 
community, beeause of its simplicity. 

An example showing the fundamentals of the template matching might be 
helpful to understand the idea better. Let us consider an image which has a 
background with a constant gray level, and some isolated particles located in thus 


background with a different grav level. Now, let us take a sample templates = 


-| -| -| 


Figure 3.2 Sample Arrav used for Template Matching. 


dimensions and assign some coefficients for each location [Figure 3.2]. This specific 
array is also known as a Laplacian Convolution [Ref. 7: pp. 9-19]. The center position 
of the template (assigned 8) 1s shifted around the unage from pixel to pixel. At every 
position, the grav levels of the nmage which correspondence to the template locations 
are multiphed with the array coefficients. Then, each local product ts added to the 
others and the value of the sum ts stored in an atrav at a location corresponding to the 
center of the template. If all image values covered by the template area belong to the 
background (constant gray levels), the sum will be zero. But, if there is a particle 
under the template area, the sum will be different from the zero. The summation will 
be maximum when the particle is located under the center position of the template. 
For other positions of the particle, the sum will be smaller. Depending on the 
preferences of the user, tle proper threshold application will eliminate these smaller 
values. By assigning the coefficient values in various ways, it 1s possible to have imanv 
configurations to segment the special properties of the images in the desired directions 
meet. 12: pp. 335-345]. 
a. 3x3 Gaussian Filter 

Tlus filter is a function in the Itex, PC library, and performs an approximate 
convolution on a local area. The user can select the Area of Interest (AOI) to be 
either a full monitor screen, a quadrant of the screen or some portion of the screen. 
The filter essentially tends to blur the image by selectively passing onlv low spatial 
frequency components. The algorithin is automatically scaled by pre-set values 
[Ref. 6: p. I[-6-5]. The kernel used for the Gaussian filter is in Figure 3.3. 

For illustration of the 3x3 Gaussian Filter’s effectiveness, images of the 
AFRT were used. Figure 3.4 shows an tmage before and after two iterations of the 
filter. Visually, the speckle has been reduced a small amount, and the blurring and 


resolution degradation effects are verv small. After the proper thresholding, the 
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Figure 3.3. The template of the Gaussianeh iirc 


filtering effect is more obvious. As can be seen in Figure 3.5, good data can be 
retrieved from the filtered image, whereas the excessive speckle in the unfiltered image 
would lead to faulty feature detection. 

The Gaussian filter can be used as a fast smoothing algorithin. It takes 
alinost 18 seconds to filter the full screen image. But, the speckle suppression is 
minimal. This 1s explained at the next section. The Gaussian filter is a general 
purpose segmentation algorithm, not a special speckle suppression algorithm. Since it 
does not use any analytical model for the speckle noise in its design, the filter treats the 
speckle like a particle, and has the same smoothing effect on both speckle and 
particles. Resolution degradation of this filter 1s rather good coinpared with the 
previous implemented filters like the Geometric, the Local Statistics aud the Sigma 
filters. 

b. 5x5 Convolution Filter 

This function performs a 5 by 5 convolution process on a predescribed 
local area [Ref. 6: p. II-6-3]. This algorithm usually produces a cleaner (1.e., less noisy) 
enhanced image than 3x3 Gaussian filter, but it takes a bit longer time to run (about 
50. seconds for the full screen). Tlie kernel used for the Convolution filter 1s in Figure 
oe 

During this investigation, the data scale factor, which is needed to balance 
the convolution filtering effect. was selected as 6, and a data offset value was selected 
between 50-60, up to the average grav level of the selected image. The data scale factor 
and data offset value are required parameters for the Convolution filter algorithm by 
the ImageAction software [Ref. 6: p. II-6-4]. 

The etfectiveness of the 5x5 Convolution filter can be seen easily on the 
AFRTI [Figure 3.7]. Visually, the speckle has been reduced considerably, but blurring 


and resolution degradation effects are much more obvious than for the Gaussian filter. 
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Figure 3.4 (a) Unfiltered Image of the AF RT (SI =0.8605338) 
(b) Same Image Filtered with Gaussian Filter ( 2 iterations, S$] =0.4154431). 
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Figure 3.5 (a) Unfiltered and Thresholded Image 
(b) Gaussian Filtered and Thresholded Image. 
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Figure 3.6 The template of the 5x5 Convolution Filter. 


The speckle suppression effect of the filter is more obvious after applying the proper 
foreshold valueWonethe filtered image: AS scan be seen in Pieure 3.8, the 5x5 
Convolution filter is much more effective at clearing the noise. but it also removes 
some sniall particles in the image. Concurrently, edges of the retrieved particles spread 
more than for the 3x3 Gaussian filter. 

This filter also does not contain any analytical noise model for the speckle, 
and is a general purpose region dependent segmentation algorithm. The speckle 
suppression effect 1s as good as the Sigma filter, but the resolution degradation effect 1s 
the worst among all of the filters. These evaluations are exhibited in the next section 


with numerical values. 


C. COMPARISON OF THE FILTERS 

In this Seotiememimest oO recently developed filters and the three nonlinear SAR 
Miers Will Devcommeatedim terms of speckle index reduction, the time needed per 
iteration, and their resolution degradation. For the three nonlinear filters, these 
comparisons were done before [Ref. 3: pp. 33-36]. To make the comparison from the 
Same reference, the Same standards and subroutines were used exactly. Then, the 
previous results and current results were combined. 

1. Comparison of the Speckle Suppression Capability 

Comparison of the speckle-suppression capability of the filters 1s done in terms 

Scie speckle index. As can be seen in Figure 3.9, the Geometric filter, the Local 
Statistics filter, the Sigma filter and the Convolution filter are approximately equally 


successful in reducing the speckle after four or more iterations. The Gaussian filter 
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Figure 3.7 (2) Unfiltered linage of the AP Ral Stam cisco, 
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Figure 3.8 (a) Unfiltered and Thresholded Image, 
(oy Gonvolution Pitered and Phresholded Imace. 
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was very slow and had the least ability to suppress the speckle. After the fourth 
iteration, its speckle suppression effect 1s almost lost. At the end of the four iterations, 
the speckle index was suppressed to 30% of its initial value. 

On the other hand, although the Convolution filter can be compared with the 
nonkinear filters, it is still more gradual at the first 6 iterations. For more iterations, it 
will have almost the same effect with the others. The 5x5 Convolution fier reaches a 
60° speckle index suppression after the fourth iteration. 

2. Comparison of the Times Needed per Iteration 

As discussed before, the Gaussian and Convolution filters are considerably 

faster than the nonlinear filters. This ts the major advantage of these filters. The times 


needed for one iteration of each filter are given in Table 1. 


Je 
Ve esti te teh eR ATION, 


ler Time 
3x3 Gaussian filter 18 sec 
5x5 Convolution filter 38 sec 
Sigma filter 2 mii, 15 sec 
Geometric filter 5 min, 44 sec 
Local Statistics filter 13 min, 45 sec 


When the times needed per iteration for the nonlinear filters were compared 
with the values previously measured [Ref. 3: p. 34], it was found that the speeds had 
improved. This is due to the installation of an upgraded processor board with a 386 
microprocessor. The times for the nonlinear filters are still considerable, because these 
fiers treed (0 be run for more than one iteration. 

3. Visual Comparison and Resolution Degradation 

Another criterion used to evaluate the performance of any filter 1s to test its 
resolution preserving ratio. All filters tend to smear and blur the edges of the image 
while suppressing the speckle. Measuring the distortion visually is a subjective process 
and changes slightly for each person. To avoid the subjective judgement, the AFRT 


was used to resolve the resolution degradation of the each filter. 


au 


Figure 3.10 shows a comparison of the measured resolution for each of the 
filter tvpes. The horizontal axis shows the number of iterations of the filter. Lach 
iteration reduces the speckle further. Resolution of the original image after 
thresholding was 12.4 microns. At the first iteration, all filters have almost the samme 
resolution degradation. As can be seen clearly mn Figure 3.10 , the Gaussian fitter has 
the least resolution degradation, but on the contrarv its speckle reduction capability is 
the worst. On the other hand, the 5x5 Convolution filter, while fast, has titesmmees 
resolution degradation. This is the major disadvantage of the 5x5 Convolution filter. 
Although this filter nught be compared with the other nonlinear filters Hke the 
Geometric, the Sigma and the Local Statistics filters to beat down the speckle, tts 
resolution capability 1s the worst at retaining the edges, basic shape and size of the 
objects. This can also be seen by close comparison of Figures 3.8a and 3.8b. 

As a conclusion, the locally developed filters will not bring any major 
advances in combining speckle reduction. operating speed, and resolution degradation. 
The Geometric filter can still be accepted as the best overalt filter from the points of 
view suppressing the speckle and retaining the basic shape and size of the objects 


{[Ref. 3: p. 39] at the expense of requiring almost six minutes per iteration. 
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IV. PARTICLE DATA ACQUISITION AND MEASUREMENT RESULTS 


The acquisition and digitization of the image along with preliminary processing 


and sizing techniques have been summarized in the previous chapters. [t 1s important 


to recall that the main goal of this investigation was to produce a svstem that is 


capable of measuring the quantity and size of the particles in the combustion chamber 


of a rocket motor. The particles are expected to be nearly spherical in shape and range 


in size from [| micron to 200 microns in diameter. 


A. 


THE PROCESS BREAKDOWN 


Once the hologram has been successfully recorded, a computer process measures 


the particle size and produces a statistical description of the particle size distribution. 


The steps required to produce this distribution can be summarized as follows: 


hy 


Image acquisition from the hologram reconstruction. During the reconstruction 
phase, the real image of one field of the reconstructed hologram is focused on a 
spinning mylar disk. The disk motion temporally varies the speckle pattern, 
While the particle images remain stationary during the 1/30 of a second 
integration time of the vidicon. Then the real image of the selected field 1s 
recorded by the VCR through a microscope. The same process is repeated to 
scan the entire hologram reconstruction volume. Each view should produce an 
independent set of particles. 


Image digitization and storage on the computer svstem. The ImageAction or 
the [tex PC software functions are used in conjuction with the PC Vision plug- 
in board for this purpose. 


Speckle reduction filtering to separate the particle image information from the 
overlaying speckle. An investigation into the tradeoff between resolution, 
speckle reduction, and the time needed for one iteration of the filter was 
discussed in the previous chapter. 


Apphecation of an image threshold to separate the image features from the 
background features. Direct observation is the usual method to evaluate the 
effectiveness of the threshold value. [listograms of the original image and the 
filtered image are good indicators to aid the user in making a decision about the 
location of the threshold. 


[eature identification to find the connected feature pixels and to recognize the 
connected pixels as a single object. As previously described, a Fortran program 
processes the thresholded image for object identification and counting. The 
object identification is done by scanning the image for adjacent pixels (at the 
horizontal, vertical and right-upper diagonals only). Adjacent pixels are joined 
to form one odject or feature. 


dO 


6. Feature sizing to produce the data table. The area and the maxtmum chord 
widths are then computed for each feature and written into a data table. (If 
desired, a roundness test can be applied to the chord length measurements to 
elrminate nonspherical particles). 


7. Producing the histogram of the data table. The data table 1s transferred into 
the STATGRAPHICS software, and the histogram 1s produced by using the 
STATGRAPHIICS funetrons. 


8. To obtain the total particle distribution of one hologram. all steps are repeated 
for the different fields of the hologram depending on the magnification. Then, 
the local histograms are added to each other using the STATGRAPHICS 
functions. 


B. CURRENT MEASUREMENT RESULTS 

During the reconstruction phase, the field of view of the microscope system 1s 
determined by the magnification required to resolve the smallest particle. Also, the 
number of particles within the field of view depends on the magnification of the 
microscope system. One question of Interest, then, was how many particles were 
enough to provide a meaningful set of statistics. Figure 4.1 shows a frequency 
histogram of particle size distribution as measured from a calibration array hologram. 
The horizontal axis is the x-width of the particle. This histogram shows the particle 
distribution of 96 particles. Figure 4.2, 4.3 and 4.4 show the data from a various 
number of fields of view from the same hologram tmage. These histograms are the 
distributions of 681, 984 and 1592 particles from 7, [0 and 16 fields of view, 
respectively. As can be seen from the figures, Figure 4.3 has the general shape of the 
distribution from larger numbers of particles for this hologram. As an_ initial 
observation, we have experimentally concluded that approximately 1,000 particles need 
to be measured before the distribution stays about the same (for the hologram used). 
This observation was verified by using an experimental hologram taken during a rocket 
firing. The five different fields of view of this hologram which also tnclude about 1,000 
particles, verified the expected shape of the distribution. Figure 4.5 represents the data 
from 288 particles in one field of view. Figure 4.6 represents the data from 909 
particles in three fields of view. Figure 4.7 represents the data froin 1179 particles in 
five fields of view. 

SO, it can be generalized that the histogram of particle size distribution reaches a 
representative shape after summing information from approximately 1,000 particles. 
Further experimentation is necessary to establish confidence levels in the data for 


different tvpes of images. 
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Particle Distribution of One Field of View 
in the Calibration Arrav. 
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figure 4.2 Particle Distribution of Seven Fields of View 
in the Calibration Arrav. 
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Parucle Distribution of Ten Fields of View 
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Figure 4.4 
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Particle Distribution of Sixteen Fields of View 
in the Calibration Array. 
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Figure 4.5) Particle Distribution of One Field of View 
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in the Real Combustion Ilolograni. 
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Figure 4.6 Particle Distribution of Three Fields of View 
in the Real Combustion Hologram. 
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Figure 4.7 Particle [Distribution of Five Fields of \ iew 
in the Real Combustion Hologram. 
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C. CONSTRAINTS OF THE PROCESS 


The major remaining problem for this investigation is the time to process the 


images. 


programs. 


\Ithough improvements were provided, it still takes significant time to run the 


The solutions for reducing the time-delav can be classified into two 


categories: hardware and software improvements. 


tL. Jlardware Solutions: 


Ih 


ty 


ieee bie} oniicroconmimicms the heartyof the system, and. it uses the 
IBM-DOS (Disk Operating Svstein) Version 3.1. DOS has some 
linutations handling more than 20 buflers. Therefore, it 1s difficult to load 
the entire screen image into a two-dinensional array. [lowever, in the 
future, using the primary memorv in order to process the inage will speed 
up the entire process. 


The IBM-’AT microcomputer already has an upgraded processor board 
with a 386 microprocessor, Which runs at 16 MHz. The system speed can 
be increased by using the more powerful and faster computers. 


2. Software Solutions: 


I. 


tt 


Current locally developed programs have been written in Fortran. Using 
another computer languages like Pascal, C or Assembler can be expected to 
bewmone eliective in speeding vip the process. 


The developed Fortran routines have an interactive structure. At first, the 
user has to describe the local window dimensions before the program runs. 
(The details about the window are in Chapter Two.) This is an obstacle for 
automatic Operation, since the program depends on the user’s observations 
to describe the dimensions of the window. Description of an optimal and 
fixed-dimension window would help the automation of the process. 


iitemeanire identilication routine has already been written to test the 
adjacent pixels in order to describe a feature in the horizontal. vertical and 
right-upper diagonal directions. The algorithm can be improved bv 
checking the other diagonals. This might decrease the time needed to join 
adjacent pixels into identified features. 
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¥. CONCLUSIGNS 


The results of this investigation show that the IBM/AT nuecrocomputer with a 
dedicated software, fast-access image memory board, and 16 Mf1{z. 386-microprocessor 
is a viable system to process the hologram images. Now, 512 x 512 images canjbe 
handled in LO minutes from fraine digitization to production of the data table. Higher 
processing rates can be achieved with faster computers. The time currently required ts 
appropriate for the feasibility studies which were carried out. 

As an mntial observation, the data from independent views of the reconstruction 
studied suggests that the histogram of the particle size distribution reaches a 
representative shape after summing information from approximately 1,000 particles. 
Further study is needed to verify this initial observation. 

As a result of image enhancement and filtering investigations, the Geometric 
filter has been found to be the best compromise filter among the others. Because 
locally developed filters (like 3x3 Gaussian filter and 5x5 Convolution filter) do not 
have any analytical representation for the speckle, they are not as successful as the 
nonlinear filters (the Geometric filter, the Sigma filter, and the Local Statistics filter). 
Especially, the 5x5 Convolution filter has the worst resolution degradation property. 
\fuch more improvement can be made toward reducing the speckle degradation due to 
filtering. 

There is still a need to improve the hologram recording and reconstruction 
techniques. Currently, resolution of the original images ts about 12 microns. Better 
optics will also help in achieving better reconstruction. 

The locally developed routines have been written in Fortran. Using computer 
languages like Pascal, C, and Assembler might be helpful to improve the speed of the 
computer processing. 

The Feature Identification routine tests the pixels to identifv the features at the 
horizontal, vertical, and right-upper diagonal directions. Checking the other diagonals 
to identify the features nught reduce the processing time. 

The Feature Identification and Sizing Fortran routines need a description of a 
local window which will be able to cover the largest feature in the current screen. Tlius 


is the weak point of the programs in the view of automation of the process. Later 


tay 
SS 


Studies need to investigate whether a fixed size window can solve this problem, and 
whether different fields of the hologram can be processed with an automatic process. 
The 4x magnifrcatron of the imuicroscope proved to provide a_ reasonable 
processing time for one feature tn one field of mage and a resolution increment of 3.7 
nucrons. As the magnification of the microscope increases, the resolution increment 
becomes smaller, more sensitive, and the resolution degradation decreases. This 
concurrently tncreases the processing time. Flowever many more fields of view are 
required to cover the hologram reconstruction volume. Further investigation ts needed 


to study the tradeoffs required. 
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APPENDIX 
LIST OF ABBREVIATIONS 


STATGRAP MICS Statistical Graphics System 
VCR Video Cassette Recorder 

AOI Area of Interest 

VMB Video Vlemorv Board 

SAR Synthetic Aperture Radar 
AFRT Air Force Resolution Target 

S] Speckle Index 

CSA L nited States-Air force 

IBM International Business Machines 
DOS Disk Operating System 
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